DCX:UMEKT RESUME 



ED 327 396 



SE 051 843 



TITLE 



Mathematics Counts in Virginia. Virginia 
International Mathematics Assessment ProDect. Mam 
Report . 

Virginia State Dept. of Education^ Richmond. 
Mathematics Service. 

National Science Foundation, Washington, D.C. 

Dec 89 

134p. 

Reports - Descriptive (141) — 



INSTITUTION 



SPONS AGENCY 
PUB DATE 
NOTE 

PUB TYPE 



EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



MF01/PC06 Plus Postage. 
Educational Assessment; ^Mathematics Achievement; 
•Mathematics Curriculum; Mathematics Education; 
Program Descriptions; Secondary Education; *Secondary 
School Mathematics; *Student Attitudes; Teaching 
Methods 

*Second International Mathematics Study; * Virginia 



ABSTRACT 



The Virginia International Mathematics Assessment 



ProDect was undertaken m response to the need for high quality 
baseline data on student achievement and on curriculum and 
instructional issues. The assessment model chosen for this project 
used the design and instruments of the Second International 
Mathematics Study (SIMS). The study included 104 schools throughout 
Virginia, approximately 800 students and over 200 teachers and 
principals. Most students were m grades 8, 11, and 12. This report 
includes a summary of the findings with reference to achievement, 
opportunity to learn, attitude, and other background information on 
both teachers and students. Chapters include: (1) "Introduction"; (2) 
"Mathematics Achievement m Virginia Schools"; (3) "Opportunity to 
Learn Mathematics in Virginia Schools"; (4) "Student Attitudes"; (5) 
"Background Data^; (6) "Teachers Teaching. . .Students Learning"; (7) 
"Implementing SIMS at the Local Level"; (8) "Summary"; and (9) 
"Recommendations." Appended are a description of the five technical 
reports that accompany this study and a saunple design. (KR) 
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Forward 



The Virginia International Mathematics Assessment Project was undertaken in response to the need for high quality baseline 
I data on student achievement and on curriculum and instructional issues. 

I We live in an era oj constant rapid and dramatic changes, where tomorrow may bring about a complete alteration in the way 

that people live and work. The growing dependence of our society on high technology demands new types of education and training 

■ /or our citizens. Thes3 changes will profoundly affect the mathematics curriculum and the way in which we teach mathematics. 

I Recent national studies have indicated that much of the curriculum is outdated, overly abstract and too theoretical. 

To make intelligent decisions, however, about what changes are necessary, an assessment of mathematics education in our 
State was needed. Most of the assessment devices currently being used for student achievement and curriculum evaluation pur- 

I poses were devised a number of years ago to serve quite different functions. We have chosen, instead, to use the design and instru- 

I ments of the Second International Mathematics Study (SIMS). The SIMS model provides a rich context of data within which student 

outcomes can usefully be described and explained. We are grateful to the National Science Foundationfor providing the necessary 

I support to explore the value of the SIMS model as it is useu in state educational systems. 

I The Study included 1 04 schools throughout Virginia, approximately 8000 students and over 200 teachers and principals. Most 

students in the Study were in grades 8, 1 1 and 12. A few students, however, were classified as tenth graders. This report includes 
I a summary of the findings with reference to achievement opportunity to learn, attitude and other background information on both 

I teachers and students. There are five technical reports that accompany this report; copies of these reports are available upon request 
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We must put Virginia in the first 
rank of states in the quality of 
education... not because of pride, 
but for the well-being of all 
Vijginians-and yes, because of 
jobs. 

Governor Gerald L. Baliles 



Introduction 



What was the Virginia International Mathematics Asaess- 

ment Project (VDIAP)? 

The Virginia IntemaUonal Mathematics Assessment Project 
(VIMAP) used the methodology and findings of the Second !nter- 
naUonal MathemaUcs Study (SIMS) to design and canv out a 
comprehensive evaluation of the eighth and twelfth grade mathe- 
matics programs in the Commonwealth of Virginia, The Project 
also calls for studying in detail the programs of two selected 
school divisions within the Commonwealth, The resulting infor- 
mation will be taken into accouiit in curriculum reform activities 
that are now being planned. 

This project was funded by the National Science Foundation 
with the expectation that it would provide other states, regions, 
and school divisions with a model that they could adapt to assist 
in their own assessment programs. 

Rationale for VMAP 

There is widespre^ J concern today with improving the 
quality of mathematics education at the school and college levels. 
Earlier in this decade, national reports such as the U, 3, Depart- 
ment of Education s Nation at Risk and the National Science 
Board s Educating Americans for the Twentv -First Centurv pro- 
vided the impetus for such concern. More recently Everybody 
Counts and Science for All Americans offer guidelines for needed 
reform. Many states have followed suit with their own programs 
of upgrading education to meet the needs of an emerging high 
technology society. 
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Essential for all such reform efforts, however, is the need for 
reliable information on program quality at present. As the 
Council of Chief State School Officers has affirmed: 

"High quality data are essential to the continuing mo- 
mentum of education reform. The publication of data 
brings education to the attention of the public and 
makes it an issue of enduring concern. By comparing 
the performamce of school, district, or state with itself 
over time, or with other schools, districts, or states, 
data serve to exhort, motivate or reward." 

(page 1 , Position Paper Adopted by Council of Chief 
State School Officers, November, 1984.) 

The Second International Mathematics Study offers an in- 
novative approach to assessing the status of mathematics edu- 
cation at a state or district level. Furthermore, since the Second 
International Mathematics Study data are now archived, com- 
parative information is available for the United States, including 
two provinces in Canada, several European countries and Japan. 
Use of the SIMS model of program assessment at the state level 
has also been made in Califc ^nia, Oregon, Iowa and Florida. In 
C'^nada it has been used at the provincial and school district 
levels. 

"Significance of VDfAP 

In the Commonwealth of Virginia, several initiatives have 
been undertaken to reform mathematics education. In 1981 , the 
Virginia State Department of Education initiated a progremi 
called the Standards of Learning (SOL). This program grew out 
of a Board of Education directive for improving education throug>^- 
out the State. The program, which includes a set of objectives for 
mathematics, establishes a framework for Instruction in the 
public schools. Subsequently, the Virginia Department of Eklu- 
cation has undertaken the Mathematics/Technology Curricu- 
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lum Project, designed to review the current mathematics offered 
in the state and to determine needed changes in content and 
emphasis as may be brought about by the changing nature of our 
technological society. 

There is, however, no systematic way of evaluating the 
degr'»e to which the goals of the mathematics curriculum are 
being reached. Virginia has a statewide testing program at three 
different levels where standardized achievement tests are used. 
The results from the achievement tests alone do not provide 
sufficient detailed information that is useful for making curricu- 
lum decisions on a statewide basis. The SIMS replication has 
helped provide the needed information for sustained curriculum 
reform efforts. 

Relevance of VIMAP to Long Term Goals of the Common- 
wealth of VirginU 

Critically important to formulating long-term goals of the 
State are reliable baseline data on certain facets of its mathemat- 
ics program. The information included in the SIMS reports has 
already been useful in identifying major content areas and points 
of emphasis as indicated from the United States data. For 
example, the results from the VIMAP provide specific information 
needed as the State works toward its goals to train and retrain 
teachers, to teach a technologically-oriented curriculum, to 
provide local school divisions with instructional materials that 
are of high quality and reflect current thinking in mathematics, 
and to design programs that will assist our boys and girls In 
developing algorithmic thinking skills while de-emphasizing 
symbolic manipulation systems. 



What was the Second International Mathematics Study 
(SIMS)? 

The Second International Mathematics Study (SIMS) was a 
project of the International Association for the E^^aluation of 
Educational Achievement (lEA) that involved a survey of the 
teaching and learning of mathematics In the schools of some 20 
countries around the world, SIMS obtained data using national 
probability samples of students (classes) from each participating 
country. In paiticular, the achievement tests were internation- 
ally ueveloped, based on a detailed analysis of the curriculum in 
each country. 

Target Populations 

In SIMS, two target populations were studied: 
Population A: Students who were 1 3 years old by the mid- 
dle of the school year (eighth grade in U,S,) 
Population B: Students in the terminal grade of secondary 
school and who are continuing in their study of mathematics 
(in U,S„ students in mathematics courses with prerequisite 
of at least algebra I, II and geometry). 
For each of these target populations, random samples of 
classes (two per school) were drawn and the students were ad- 
ministered the tests and questionnaires. The mathematics 
teacher for each class also completed several questionnaires, 
including one that asked whether or not the mathematics re- 
quired to respond correctly to each item on the student's test had 
been taught to the class. This information from the teachers, 
called "Opportunity to Learn Data", was very useful in helping to 
explain patterns of mathematics achievement that were found in 
SIMS (see, for example, the U, S, National Report on SIMS, The 
Underachieving Curriculum) , 
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The SniS Model 

The Study is based on a model that views the curriculum 
from three points of view: 

The Intended curriculum: The mathematics that students 
in target populations are intended to know. 
The Implemented (taught) curriculum: The mathematics 
that the students were actually taught . 
The attained curriculum: The mathematics that the stu- 
dents have attained or achieved . 

This model provides a rich context of data that is very useful 
in explaining patterns of student achievement, 

THREE ASPECTS OF A CURRICULUM 
Component Level of Focus 



Curriculum 
Analysis 



Intended 
Curriculum 



Cducatlon£d 
System 



Classroom 
Processes 



Implemented 
Curriculum 



School and 
Classroom 



Student 
Outcomes 



Attained 
Curriculum 



Student 
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What were the mi^or findings of SIMS as reported in The 
Underachieving CllPlTlllUm? 

Th^* Study provided detailed data on the teaching and 
learning of school mathematics in the United States from an 
international perspective. 



Eighth grade 

• U. S, achievement in arithmetic and algebra was at about the 
international average. But achievement in geometn^ ajid meas- 
urement was well below average, among the lowest one-fourth of 
the twenty participating countries. 

• Teacher coverage of mathematics (called *Opportunity-to- 
Learn ) was highest in those countries having highest achieve- 
ment. That is, those countries providing the greatest opportunity 
to learn mathematics were those in which student achievement 
was the greatest. 

• In the United States there is not an eighth grade curriculum. 
The Study identified four curricula that had dramatically differ- 
ent mathematical content. This content ranges from grade school 
arithmetic for one of the class types (remedial) to high school 
freshman algebra for another. This differentiation between classes 
was more dramatic than in any country in the Study. In Japan, 
for example, all junior high school students are provided the 
same curriculum. In the seventh grade, in Japan, all students are 
taught algebra. 

• From an international point of view, the U. S. curriculum 
has a great deal of repetition and is lean. Compared with many 
other countries, the curriculum lacks challenge and vitality. For 
example, it offers relatively little geometry, probability or topics 
in data analysis. 

Twelfth Grade 

• At this level, only students who are "mathematics majors" 
were tested. In the L\ S. these were students having completed 
at least two years of algebra and one year of geometry. Neverthe- 
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less, U. S. student achievement on the international test was 
among the bottom one-fourth of all of the countries in the Study. 

• The proportion of students in the United States that is 
studying advanced mathematics is about average for the coun- 
tries in the Study. Several countries, including, for example, 
Canada (British Columbia) and Hungary, enrolled greater pro- 
portions of students in advanced mathematics classes. Japan 
enrolls about the same proportion of students as does the U. S. 

• In most countries, all students who are in advanced mathe- 
matics study calculus. In the U. S., only about one-third of the 
advanced mathematics students enroll in calculus, (In Hungary, 
all students who remain in school— about 50% of the young 
people— are expected to study advanced mathematics, including 
calculus.) 

How The Virginia Study was conducted 

The Virginia International Mathematics Assessment Project 
was carried out in three phases: 

Curriculum Analysis Phase 

An analysis of the mathematics curriculum was conducted 
for the two target populations. This curricular information was 
used to assess the adequacy of the SIMS item pool for program 
evaluation in Virginia. 

Testing Phase 

Probability samples of classes were drawn from the entire 
state fo' each of the two target populations (see Appendix B for 
further details). The students were tested (Attitudes and Achieve- 
ment) at the end of the 1986-87 school year. Data were obtained 
from teachers on "Opportunity-to-Learn" that is the extent to 
which the subject matter on the tests had been taught to the 
students being tested. 



Analysis and Reporting Phase 

The data were analyzed 2ind preliminary reports generated 
for use by classroom teachers and supervisors in Virginia and 
personnel at the Virginia Department of Education. Reports were 
also prepared for national and international distribution. 



Schedule of Activities 

The schedule below indicates the main activities of the Vir- 
ginia International Mathematics Ascessment Project. 

December 1984 Meeting with state supervisors 
NSF I^oposal is funded 
Planning meeting for VIMAP 
Curriculum Analysis is begun 
Curriculum Analysis is concluded 
Sampling plan is completed 
Schools contacted for testing 
Orientation for teachers 
Data collected 

Data cleaned and organized for 
analysis 

PreliirJnary reports released 
Analysis continue 
Final report begun 
Final reports prepared 
Final reports released 



Summer 1985 
Fall 1985 

Spring 1986 
Fall 1986 
Spring 1987 
Spring 1987 

Fall 1987 

Spring 1988 
Fall 1988 

Spring 1989 
Fall 1989 



Target Populations for Virginia 

These populations were studied, to correspond with those in 
the international study: 

Population A: All students enrolled in mathematics classes 
offered at eighth grade level. 

Population B: All students enrolled in mathematics classes 
that have prerequisites of at least algebra 1. geometry and 
algebra II. 
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Both Population A and Population B were important to the 
study in Virginia. Governor Gerald L. Baliles of Virginia ap- 
pointed a Commission on Excellence in Education to make 
recommendations for moving Virginia into the top rank of states 
in the quality of education it offered. The Commission concluded 
that education in the middle school grades in Virginia was not 
living up to expectations nor keeping abreast of current trends in 
society. As a result of this report, the state Department of 
Education began an initiative to restructure the middle school. 
Since the eighth grade is the last year of middle school, it seemed 
appropriate that we assess the mathematics program and collect 
data on student achievement, attitudes of students and teachers, 
classroom processes, and the opportunity-to-learn mathemat- 
ics. The SIMS model provides the framework to gather baseline 
data of this nature. 

Several international studies on school mathematics have 
found that U. S. students at the twelfth grade level are not 
achieving at the level of students in some other countries. Com- 
parison of student achievement in Virginia to that of the United 
States as a whole and with other countries make it possible to 
identify areas needing change, guidelines for curriculum changes 
and for inservice and preservlce education. 



BftATHBlfATICS AcHIEVBMBNT In ViROINIA SCHOOLS 



Numeracy is ttie ability to cope 
confidently with the mathematical 
demands of adult li/e. 

Mathematics Counts 
(Inquiry into the teaching of mathematics in 
England and Wales. 1982). 
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Eighth srade ochievment in arithmetic is about at the international 
average for the United States and a Jew points above the U.S./or Virginia. 



ALGEBRA 
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Eighth grade scores in algebra were, on average, somewhat higher in 
Virginia than in the United States as a whole. 
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Mathebiatics Achievbbibnt In Virginia Schools 



Eighth Gra Je 

GEOMETRY 

so 




In geometry, Virginia scored Just slightly above the United States as a 
whole, which was cunong the bottom one-fourth qf the countries in the 
Study. An important goal qf the international investigation was to find 
reasons for this performance. 



STATISTICS 




Statistics achievement, a measure qf students' ability to understand and 
work with data, was a little higher in Virginia than in the United States 
as a whole. In many countries, including the U. S., this aspect qf the 
curriculum is receiving increased attention in current r^orm ^orts. 



BfEASUREMENT 
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In mettsurement, eighth grade students in Virginia, scored slightly below 
the United States as a whole, which was cmong the lowest onefourth of 
the countries. It is important to note that, since the test w€ts internationally 
developed, the metric system qf units was used (the metric system is IbC 
si^tem qf measurement in all other countries in the study.) However, not 
all qf the items required a knowledge qfthe metric system itse\f. Rather, 
they require understanding concepts qf measurement and how to apply 
them. 
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Mathematics AcmEVEBiENT In Virginia Schools 



The overall pattern of Virginia scores corresponds remarka- 
bly with that of the U, S, scores. For example, in the topic areas 
of arithmetic and algebra, the was at the international 

mean, Virginia scored a few points above the U, S, on these 
topics. In geometry and measurement, the U, S, was somewhat 
below the international mean. The scores on these two topics for 
Virginia are virtually identical to those of the U, S, In statistics, 
the U, S, scored a few points above the international mean and 
Virginia scored four points above the international mean. 

Achievement Compai^iSons: 
Virginia vs. the U. S. and International 
Subtest Scores: Eighth Grade 

(Mean Percent Correct) 

United Inter* 



Topic 




Virginia 




States 




national 




Over- 


Reme- 




Pre- 










all 


dial 


(xeneral Algebra Algebra Mean 


Mean 


Arithmetic 


53 


30 


44 


58 


76 


51 


51 


Algebra 


46 


23 


35 


50 


75 


43 


43 


Geometry 


38 


25 


33 


40 


55 


38 


4^ 


Statistics 


59 


41 


51 


64 


78 


57 


55 


Measurement 


41 


27 


35 


44 


59 


42 


51 



What conclusions might be drawn from these findings? We 
first must remind ourselves that, overall, the S, scores at this 
grade level are close to the international mean which t^uggests 
that achievement in some other countries was higher While a 
particular score may not be important, it is important that wc 
look at our state goals for eighth grade mathematics and decide 
where they are, and where emphasis should be placed. For 
instance, in Virginia we have a goal to provide an opportunit> for 
all students to study algebra, including the lower level classes. 



The findings of this study clearly support the implementation of 
this goal. It should be noted, however that Virginia students en- 
rolled in algebra classes scored significantly higher than the U, S, 

The VIMAP data indicate very clearly, however that consid- 
erable attention needs to be paid to the topics of measurement 
and geometry. While some of the reasons for our low performance 
on measurement may be attributed to the fact that only the 
metric system was included on the test, not all of the blame can 
be placed there. For example, only about one-half of our students 
are able to read a scale (admittedly, only 40% of the students 
acr^s the countries could do so-but that does not detract from 
the basic importance of this topic!). 

With respect to statistics, at first glance It may appear that 
all is well, with Virginia scoring four points above the intema- 
tiou£il mean! But we are not sure, we must look at our curriculum 
to see, if indeed, we are where we wou Id like to be in this important 
area of mathematics. Here in Virgini-i, as in many other places, 
great importance is attached to the ability to work with data-to 
collect and organize numerical information in such a way that it 
can tell a story effectively. The VIMAP data suggest that we may 
be in reasonable shape with routine tasks, such as reading a bar 
graph, but have we reached our goal ol quantitative literacy for 
£ill of our youngsters in school? 
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The national spotlight is turning on 
mathematics as we appreciate its 
central role in the economic growth 
of this country... it must become a 
pump instead of a filter in the 
pipeline. 

R. M. White (as cited in 
Everybody Counts . 1989) 
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Mathebcaucs Achievbiibnt In Virginia Schools 



Twelfth Grade 



(ADVANCED) ALGEBRA 



60 

20 



11 III 



Advanced algebra and calculus provide the b€isis for competence in 
science and technology. The data far the ttvelfth grade represent the 
achievement qf our most advanced mathematics students-those who are 
enrolled in mathematics courses requiring at least algebra h geometry 
and algebra JI. V^^yinia students scored, on OM^erage, higher than the 
United States as a whole, in both advanced algebra and calculus. 



ELEMENTARY FUNCTIONS/CALCULUS 
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Mathematics AcmEVBBO&NT In Virginia Schools 



Twelfth Grade 



GEOIIETRT 




Geometry and number systems, show patterns qf achievement sUnilar to 
algebra and calculus. That is, the 17. S. Is among the lowest one-fourth 
of the countries and Virginia tends to he a few points higher in achievement 
than the U. 3. 
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Virginia and the United SUtes 
Subtest Scores: Twelfth Grade 

(Mean Percent Correct) 



United Inter- 



Topic 


Virginia 






SUtes 




national 




Prc- 


Ov(?r- 


Prc- 


Over- 






Calc 


Calc 


all 


Calc 


Calc 


all 


Mean 


Sets & Relations 


45 


60 


49 


54 


64 


56 


61 


Number Systeins 


41 


50 


42 


38 


48 


40 


47 


Algebra 


44 


61 


48 


40 


57 


43 


57 


Geometry 


33 


41 


35 


30 


38 


31 


42 


Functions/Calculus 


30 


57 


37 


25 


49 


29 


46 


Probability/StaUsUcs 


38 


55 


41 


39 


48 


40 


46 



Again, as with the eighth grade, there Is a correspondence 
between the scores of the Commonwealth and of the entire U« S. 
This Is particularly so for the pre-calculus classes. For the cal- 
culus classes, Virginia tends to score a few points above those of 
the U, S. On the calculus subtest, the difference Is dramatic, with 
Virginia students eight points above the U. S. and among the 
top one-fourth of all countries. 

The topic area where Virginia's performance was lowest was 
sets and relations. Further analysis of the data will be done to 
determine reasons for this. It Is likely, for example, that the topics 
are not covered heavily by many Virginia teachers. In geometry, 
Virginia students obtained an average score above the U, S. but 
a few percentage points below the International mean. 
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Opportunitt-to-Lbarn BIathebiatics or Virginia Schools 



Today's mathematics opens doors 
to tomorrow's Jobs. As successive 
waves of immigrants have used 
this country's educational system 
to secure better Uves for themselves 
and their children, so today's chil- 
dren the world over are using 
mathematical training as a plat- 
form on which to build up their 
lives. America's children deserve 
the same chance. 

Everybody Counts 1989 



The Second International Mathematics Study provided a 
new kind of data — data that were not available In any other klnrt 
of mathematics survey at that time. The information provided, 
called "Opportunlty-to-Leam", was obtained by asking teachers 
to Indicate, for each item on the international test, whether or not 
that mathematics had t ^n taaghl to the class, either during the 
school year, or prior to that school year. The same kind of data 
was gathered in the Virginia study. 
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In ^his yrapht hitemaJdanal and VIryinki acMeoement data are shoumjar 
eighth grade aigOtrafBeoenth grade in Japani* Virginia^ along uHih the 
countriee are ranked from high to tow in achievement. The length qfthe 
bar for each country ahaum the tunount qf teacher coverage qfthe aigtdtra 
items on the international test. (Hungarian teachere reported highest 
coverage J Qenerally. the graph suggests, the higherachievittg countries 
were those having higher teacher coverage. 
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OlTORTUNnr-TO-LBARN BftATHEMATICS IN VIRGINIA SCHOOLS 



Eighth Grade 
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Oppartunity-to-Leam geometry for eighth grade students was, on aver 
age, relatively low for students in all countries. The graph indicates that 
topically less than one-half qf the geometry on the international test was 
covered by the teachers (note the exception for Hungary!)* VIryinia 
teachers reported covering a little more geometry than V* S. teachers as 
a whole-ond student achievement was someivhat higher. 
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Teacher coverage qf the topics on measurement was reported to be 
generally high in all countries and Viryinia. Even in the United States, 
where the metric system is not yet commonly used, coverage was around 
seventy percent* The low student achievement in the United States 
generally, and in Virginia in p€U'ticular, warrants closer scrutiny in the 
light qf the high teacher coverttge qf the mettsurement items* 
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Opportuntty-to-Learn Mathematics in Virginia Schools 



Eighth Gnde 

The following selected items help to illustrate the findings of 
the Virginia International Mathematics Assessment Project. For 
each item, reported teacher coverage and associated student 
achievement are shown. 



STATISTICS 
Pwent OflMMs T««glit 

O ao 40 M M 




(Lot* AcktoTMMal) I 



I 2 3 
Time m Hours 



Thrrf hours aftr r starting 
rar A is how manv 
kilometers ahead ol tar B'' 
A 2 C 15 E 25 
U 10 *D 20 



160 










1 ; 




1 1 


UNO 




I W 


1 




T 



The diagram shows a cardboard 
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somf cdgfs and folded out Hat 
If It is folded to again make 
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OppoRTUNnr-TO-LBARN Mathematics in Virginia Schools 
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On the above scaJe the reading 
indicated by tlie anow is 
between? 
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A 51&52 
B 57 A 58 
C 60&62 



D 62&&I 
•E fv4A66 



Since mathematics is the founda- 
tion of science and technology, it 
serves as a key to opportunity and 
careers. 



ERLC 



Everybody Counts (1989) 
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Twelfth Grade 



(ADVANCED) ALGEBRA 
PMMt or itMu Tan^t 

0 ao 40 M to 100 



Japan 


• 


Finland 




England /W»)e« 




Israel 




Sweden 




Canada (Ont 1 




W-w Zealand 




VhjMa 




Canada (B C ) 




Hun{{aiy 




Unltrd States 




Thailsmd 



Teachers report high coverage qf the advoMwed algeSnxL topics in all 
countries and in Viryinia. The Ujw student achievement in some qf these 
countries is, apparently, due to factors other than low teacher coverage. 
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In most countries in the irtemadonal study, calculus is a standoftl topic 
in advanced mathematics classes (twelfth grade in the U. SJ However, in 
the United States including Virginia, only a relatively small proportion qf 
advanced mathematics students take calculus. 
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OpPORTUNITY-TO-LeARN MATHEBfATICS IN VmGINIA SCHOOLS 



Twelfth Grade 
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There Is little agreement internationally as to what topics should he 
included in geometry. The relatively low teacher coverage for geometry 
r^ects this lack qf consensus. 
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In the C/» S., and in Virginia, about one out of three advanced mathemat- 
ics students was taught this topic. 
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Student Attitudes 



..We see classrooms as places 
where interesting problems are 
regularly explored using important 
mathematical ideas. 

NCTM Curriculum and Evaluation 
Standards for School Mathematics (198'^) 
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Attitudes of Students 

Gaining knowledge about mathematics Is not the only 
important outcome of education. How students feel about 
mathematics, and how they view the subject are also of great 
concern, 
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The graphs here report data on how students regard activi- 
ties in mathematics classrooms with respect to their importance, 
ease and enjoyment. 
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Student Attitudes 



Checking Work 
Eighth Grade 

Checking vour work in mathematics class was regarded as 
important by the vast majority of eighth grade students in 
Virginia--as it was by their counterparts across the United 
States. Checking work was also seen as being rather easy, but 
students tended to not like doing it. Nearly one-half of the 
students in both Virginia and the U. S. as a whole reported 
disliking checking their work. 
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Twelfth Grade 

The attitudes of twelfth grade mathematics students toward 
checking their work are remarkably similar to those of the eighth 
graders. They tend to feel that it is important to do. is easy, but 
they do not like to do it. 
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Student Attitudes 



Memorlcing Rules and Formulas 
Eighth Grade 

Mathematics as mostly memorizing seems to be a popular 
view held by many Virginia eighth graders, and by almost exactly . 
the same proportion of U, eighth grade student, too. The 
students (in both Virginia and the entire country), by a vast 
majority, regard it as important to memorize rules and formulas, 
but less than one -fourth of the students like to memorize. (Note 
the contrast of these attitudes with their attitudes toward using 
calculators.) 
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Twelfth Grade 

MatbeiTiatics as mostly memorizing was an attitude about 
mathematics held by Virginia's advanced mathematics students 
(and by those across the S.), About 80% of the advanced 
students regard it as important to memorize, nearly one-half of 
them dislike doing so. Interestingly, nearly one-half of the ad- 
vanced students report it easy to memorize rules and formulas. 
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Student Attitudbs 



Using Calculators 
Eighth Grade 

Using calculators is liked by nearly 80% of the ^^rglnla 
eighth graders and by three-fourths of the U. S. students at this 
level. Nearly 90% of the A^rginia students state that it is easy to 
use calculators. However, the students at this grade level are less 
strong in their feelings about the importance of calculators. 
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Twelfth Grade 

Using calculators In advanced mathematics is regarded as 
easy by nearly all of the students and is liked by 85% of them. 
They are also in rather strong agreement about the importance 
of calculators in advanced mathematics. 
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Student Attitudes 



MatheniAtlcs and Society 
Eighth Grade 

It is important to know mathematics In order to get a g ood 
job . Knowing mathematics will help to get a good job Is an attitude 
shared by the vast majority of Virginia eighth graders. In the light 
of this attitude, one wonders the extent to which students are 
motivated to continue in the study of mathematics throughout 
high school. 
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Twelfth Grade 

The role of mathematics In helping one get a good job Is 
regarded as important by twelfth graders In Virginia. 



1 would like to work at a job that lets m e use mathematics. 
Wanting to use mathematics on t!:e job was an attitude of only 
about one-third of the eighth grade students. However, at the 
twelfth grade level, about one-half of the advanced mathematics 
students look to using mathematics in employment. 
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Student Attitudes 



Mathematics and Society 
Eighth and Twelfth Grade 

Mathematics is useful in solving everyday problems. Eighth 
giade students report a belief that mathematics is useful in 
soMng eveiyday problems. This would appear to provide an 
opportunity to capitalize on this interest and incorp)orate more of 
such problems in the curriculum. 

Advanced mathematics students are even more in agree- 
ment about the importance of mathematics in the real world. 
Again, an apparently important opportunity for curriculum and 
instruction! 
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Word problems are more fun when vou use a calculator. 
Calculators can help make mathematics class more enjoyable. 
Many eighth grade students seem to believe this. Perhaps this 
provides encouragement for making greater use of this teaching 
device. 

Advanced mathematics students tend to like to have calcu- 
lators available when doing word problems, too. Apparently, 
calculators are regarded by many students as a tool that adds 
enjoymen^ class. 
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Student Attitudes 



Mathematics and Myself 
mghth and Twelfth Grade 

I rp^llv want to do well in mathematics. The desire of 
most (nearly 90%) eighth grade students in Virginia to do well in 
mathematics would seem to be a source of encouragement to 
mathematics teachers, administrators and parents. 

Advanced mathematics students are virtually unanimous in 
their desire to do well in mathematics. These students have 
remained in mathematics classes for most if not all of their high 
school experience. 
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I am looking forward to taking more mathematics. Eighth 
grade students are less in agreement about the prospect of taking 
more mathematics-in spite of their recognition of its importance 
in getting a good job. 

Twelfth grade students in advanced mathematics class in 
Virginia are less in agreement in their looking forward to more 
mathematics than are their U, S, counterparts. Less than one- 
half of the Virginia students reported they were looking forward 
to more mathematics while nearly sixty percent of the U, S, 
students were. 
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Student Attitudes 



What BCathematics Is Like 
Eighth and Twelfth Grade 

Students learn the subject matter of mathematics (arithme- 
tic, algebra, and so on) but they also learn things about the 
nature of mathematics-what is mathematics like? Is it, for 
example, a fixed body of knowledge that has remained much the 
same for the past 100 years or so? Does mathematics consist of 
sets of rules and formulas that are to be memorized and given 
back on tests? Does doing well in mathematics mainly mean 
having a good memory? 

In the Second International Mathematics Study a set of 
items was devised in order to measure how one views mathemat- 
ics as a field of study. 



Mathematics is a good field for creative people. Mathemat- 
ics as a good field for creative people was a point of view held by 
approximately one-half of the Virginia eighth graders and by only 
slightly more in the U. S. sample. This seems to indicate that 
students see little room for creativity in mathematics. 

Mathematics as a good field for creative people is regarded 
by an even smaller proportion of advanced mathematics students 
than the eighth grade group. Less than one-half of the Virginia 
students reported seeing mathematics in this light. 
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Student Attitudes 



What l8 liathematics Like 
Eighth and Twelfth Grade 

New discoveries in mathematics are constantly being made. 
Only about one-third of the eighth grade students report believ- 
ing that mathematics is a changing field. 

Close to the same proportion of advanced mathematics 
students as eighth graders regard mathematics as having new 
discoveries. This view of mathematics as a fixed body of knowl- 
edge is a disconcerting one, especially when found in those at the 
end of their secondary school studies. 
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A mathematical problem can always be solved in nianv 
different wavs. In Virginia, over one-half of the students in the 
eighth gi ade see that there can be flexibility in solving mathemat- 
ics problems. Fortunately, this attitude has somewhat increased 
for those students in the twelfth grade advanced matl^ematics 
classes, and they realize that there can be multiple solutions to 
mathematics problems. 

In both of the grade levels for both tht ^\ S, and Virginia, 
about one-fourth of the students disagree and one-fourth are 
undecided about whether a problem can be solved in many 
different ways. This means that we have a long way to go in order 
to dispel the attitude that there is only one solution when solving 
a mathematical problem, 
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Student Attitudes 



What Is Ifathematicf^ Like 
Eighth and Twelfth Grade 

Mathematics is a set of rules was an opinion endorsed oy 
over forty percent of the eighth grade students in Virginia, Dis- 
tressingly, about the same proportion of twelfth grade students 
shared this opinion of mathematics. 
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Nearly one-half of the eighth graders also expressed agree- 
ment with the idea that learning mathematics involves mostly 
memorizing . On the other hand, the eighth grade students did 
have a somewhat open-ended view of mathematics in that nearly 
one-half of them agreed that a loathematlcs Problem can always 
be solved in different wa ys. Nearly sixty percent of them agreed 
that estimating is an important mathematical skllL Again, the 
opinions of the Virginia students corresponding very closely with 
those of the U, S, students. 
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Student Attitudes 



What Is Mathematics Like 
Eighth and Twelfth Grade 

The attitudes of the advanced mathematics students toward 
mathematics as a subject of study were similar to those of the 
eighth grade students in that over forty percent view mathemat- 
ics as a set of rules and over one-half agree that a mathematics 
problem can be solved in different ways. However evidence of 
some maturity in mathematical thinking could be inferred from 
the finding that over fifty percent of the advanced students 
disagreed with the statement that learning mathematics involves 
mostly memorizing, 
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Home Support 

Eighth and Twelfth Grade 

Home supp ort. One of the best documented findings in 
educational research is that support from the home is a veiy 
powerful predictor of a student's success in school The following 
items were designed to measure the extent of support and en- 
couragement from the home for studying mathematics. 

Mv parents want me to do well in mathematics class. Nearly 
all of the students in the eighth grade classes agreed with this 
statement. At the twelfth grade level approximately 90% of the 
students agreed with the statement. 
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Student Attitudes 



Home Support 

Eighth and Twelfth Jrade 

Mv parents are interested in helping me do mathematics. At 
the eighth grade level, about two-thirds of the students agreed 
with this statement However at the twelfth grade level, far fewer 
students held this view. Only about one in five of these students 
see tb^ir parents as interested in helping them with their 
mathematics. This could be that the students regard their 
parents as not having the needed background to be helpful at this 
level of mathematics. 
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Boys need more mathematics than girls. About two-thirds of 
the eighth grade students disagreed with the opinion that mathe- 
matics is more important for boys than girls. In the advanced 
classes, three-fourths of the students had this opinion. It is 
interesting to note, however that in both groups, about one 
student in five was undecided about this statement. 
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Background Data 



Calculator Use 

Eighth and Twelfth Grade 

The extent of calculator use In Virginia mathematics class- 
rooms was found to be very limited at the eighth grade level, with 
very few classes reporting use more than one period per week and 
one- third of the classrooms reporting no use at all. Calculator use 
was much more frequent in Virginia's advanced mathematics 
classrooms. 



PERCENT OP MATHEliATICS CLASSES 
USING SCIENTIFIC CALCULATORS 



100 80 60 40 ao 



TWl^VBOIIADC 
(Admemd mmthmmatlcai 



ao 40 ao to 100 



2 or tnorr 
' nfxls Prr Wrck 

W«*k or Lpss 




Etqhth Crck^e- About 26% of the teachers did not respond 



From the data reported in the previous section on "Student Attitudes" students 
at both levels see the calculator as a us^l tool in mothematlcs. 
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The kinds of calculator use in Virginia mathematics class- 
rooms Included checking answers and doing projects at the 
eighth grade level. Doing homework and problem-solving were 
more frequent uses reported at the advanced mathematics level. 
Recreational uses were rather common at both levels. 
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Homework Assigned 
Eighth and Twelfth Grade 

The amount of mathematics homework assigned in the 
United States is about two and one-half hours per week (30 
minutes per day) at the eighth grade and almost twice as much 
(Just over four hours per week) in the twelfth grade college 
preparatory mathematics classes. The Virginia data are pre- 
sented here in "box-£md-whisker" plots that show a similar 
pattern. The boxes include the middle fifty percent of the mathe- 
matics teachers reporting. The line across the middle of each box 
represents the median or middle score. So, the median amount 
of mathematics homework assigned to the advanced mathemat- 
ics classes is close to four hours per week. That ^s. about fifty 
percent of the classes were reported as having less than four 
hours of homework assigned. The lines protruding from each end 
of the box (the **whiskers") encompass the middle 90% of the 
classes reporting. So. we see that 90% ^ he eighth grade classes 
were assigned between one-half hour and seven hours of mathe- 
matics homework per week 
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With respect to mathematics homework, most eighth grade students reported 
spendV ,g one and a ha\f hours per week on homeworkfor the one mathematics 
class, while twelfth grade students spent from three to Jive hours per week for 
their one mathematics doss. 
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Background Data 



Mathematics Instruction 

Mathematics instruction in U. S. classrooms is clearly text- 
book-driven. The textbook largely determines what is taught as 
well as what strategies are used in teaching it. Even when not ac- 
tually determining the content of instruction, the textbook al- 
most always defines the boundaries for instruction. According to 
the reasons given by teachers for using various instructional 
strategies and representations of mathematical content, inclu- 
sion in the textbook did not always guarantee that a strategy or 
content representation would be used in the classroom. However, 
exclusion from the textbook made it virtually certain that the 
strategy or representation would not be used. Mathematics 
instruction in the U. S, seemed to have been mor e tied to the text- 
book than was instruction in most other countries. One could 
speculate as to reasons for this. For example, it could be because 
of the absence in many parts of the U. S. of syllabi and examina- 
tions that are beyond the local school or district level. 
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The student textiAJOk is the predominant instructional resource in the U. S. 
eighth grade mathematics classrooms, and is so reported by ninety percent qf 
the teachers. Other material, such as workbooks, and worksheets, were 
reported to be qf secondary importance. Other materials, such as films <u%d 
laboratory materials, seldom were cited as a primary resource, and were rarely 
or never used by the vast mt^rity qf teachers. This was true even for topics 
such as geometry and measurement were such materials might be considered 
most helpful, ^ 




Background Data 



How Studento' Time Is Spent: Vlrgliila 

Teachers were also asked to estimate the average time spent 
by students In selected in-class activities. For eighth grade S. 
students the majority of time was devoted to individual work at 
their seats or to listening to lectures and explanations by the 
teacher A little less than one class period per week was typically 
spent on taking tests and quizzes. Very little time was spent in 
work with small groups. The pattern was similar for twelfth grade 
students in the U, S, , although they spent somewhat less time on 
individual seat work and relatively more time listening to teacher 
explanations. 

How Students' Time Is Spent: Virginia 
(Median Blinutes Per Week) 



Twelfth Grade 
Bightli Grade (Advanced Bfathematics) 



Taking Tests 


50 


48 


Doing Seat Work 


75 


50 


Whole Class Listening 


90 


130 


Small Group 


15 


20 




thm mt,.Hm„t^< time iaapewt. ahoiM both e<0hth 



and twe|/th gnde 9tudent» aeem to be gprnding about 1 hour a week taking 
tests. The eighth graders are reported as having to do a little more eeatiM»rk« 
while twelfth graders do a tot more listening. Uttfortunately, like the U.S., 
neither group spends very much time in small group activites. 




The majority of student in-class time was thus seen to be 
devoted to one of two types of activities: listening to teacher talk 
or individual work with minimal interaction with the teacher. The 
two types of activities often seem to have occr^ied distinct phases 
of the class period Little place seems to be given to guided, active 
discovery learning, in which students generated high-level ques- 
tions and in which there was more of a balance between teacher 
and student subject-related talk. This pattern was not that 
different from that of other countries although the proportion of 
time spent on individual, in-class seat work was somewhat 
higner in the U. S, 

lONUTBS PER WEEK 
(Per OaM) 

IJQHIir OKAOI TWELFTHOSADS 

(ADVATfCED mATSEMATKai 

100 to eo 40 ao o ao 4o eo to loo lao i4o 



TAKING TESrrS 
& QUIZZES 



WORK 



USTENING TO 
LECTURE 



WORKING IN 
SMALL GROUPS 




The graph above shows how students* time in cloee was reportedly spent (in 
minutes per week for the classes sampled). 



How TeacherB' Time Is Spent: Viiginla 

One Important aspect of VIMAP is to look at how teachers' 
time is spent. In Virginia, eighth grade teachers reported that 
they spent about 385 minutes (about 61/2 hours) per week doing 
certain Instructional activities. Over 11/2 hours are spent on 
each of the following: planning, grading, and explaining new 
content. About 1 hour is spent on review weekly and only about 
1/2 hour on administration and discipline. In the advanced 
mathematics classes considerably more time is spent planning 
and explaining; a little more time is spent grading papers and 
reviewing material; and much less time is spent on administra- 
tive and discipline matters. 

Minutes Per Week 
(per class) 



Twelfth Grade 
Eighth Grade (Advanced Mathematics) 



Planning 


100 


142 


Grading 






Papers 


100 


112 


Explaining 






New Content 


100 


140 


Reviewing 






Content 


50 


57 


Routine 






Administration 


25 


• 15 


Maintaining Order 






(Discipline) 


10 


3 



Background Data 



Teachen' Use of Resources: Virginia 
(percent) 

Twelfth Grade 
Eighth Grade (Advanced Mathematics) 



R S O 



R 



Published 

Textbooks 7 44 47 

Published 

Workbooks 27 44 16 

Individualized 

Materials 25 47 25 

Commercial Visual 

Materials 53 28 2 

Commercial 

Tests 42 26 7 

Self-written 

Textual Material 6 53 41 
Self-wriitten 

Tests 5 54 40 



2 4 94 

49 40 11 

78 19 3 

51 46 3 

63 34 3 

1 22 77 

1 4 95 



Note: Rmrarely; Sm3ometime9; and O-q/ken 

Teachers in Virginia reported that the textbook was one of 
their major resources with over 90% of the eighth and twelfth 
grade teachers reporting regular use of the textbook. A large 
percent of Virginia teachers reported that they usually develop 
their own tests (99% of the twelfth grade teachers and 94% of the 
eighth grade teachers). Another heartening phenomenon in 
Virginia is the large percent (99% at the twelfth grade and 94% at 
the eighth grade) of teachers who rewrite and thereby adapt 
textual material for their own students. 



77 



Background Data 



Activities of Teachers 

Activities at teachers meetings in the U. S. and Virginia at 
bo^h grade levels tend to focus on organizational matters. Little 
attention was reportedly paid to teaching strategies or to content, 



PBRCBNTAOB OF SCHOOLS 
Population A l^pulaHonB 

100 to eo 40 ao o ao 4o eo oo 



TEACHING 
STRATEGIES 



Japan 



United SUlcs 



VlfglnU 



coivrrENT 



Japan 



United States 



Virglala 



ORGANIZATIONAL 



Japan 



United States 



Vlrgtate 





too 



4 h 



INTBlf Snr or MATHBMATICa DfSTmucnoN 



Belgium (Flemish) 



Canada (B C ) 



United States 




Intensity qf mathematics instruction at the Population A level (eighth grade in 
the U. 8 J, baaed on teacher report* qf anticipated pern ntage qf class periods 
devoted to varioua topice, ghontm diMtinct patteme across countries. The 
Japanese curriculum provides their seventh graders with an intensive 
introduction to algebra^ The Belgian and French programsjdcus on geometry 
and extensive work on common fractions (decimalfractions were dealt with in 
the elementary grades). In Virginia, as in the U. S., the carriculum has little 
intensity; hut, a concerted ^ort across the entire curriculum. 
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32 



A unique feature of the Second International Mathematics 
Study is that it enables a detailed look at the teaching and 
learning of specific mathematical topics. One analysis that 
provides useful information is that of comparing reported teacher 
coverage of topics with student achievement on those topics. 

The relation between teacher coverage and student achieve- 
ment has already been demonstrated in this report. In fact, a 
major finding of the Second International Mathematics Study is 
that high student achievement is found in those countries where 
teacher coverage of those topics is high. With this in mind, it is 
of interest to look in some detail at the data from Virginia on 
teacher coverage and student achievement. We will classify the 
items from the international test in two ways: according to 
teacher coverage (high or low) and according to student achieve- 
ment (high or low). As a result, each item can be one of four types, 
as the diagram below suggests: 



High 



Low 



TYPE 11 


TYPE/ 


TYPE III 


TYPEIV 



Low Hlch 
Student AchleYement 



Teacher coverage of the item is rated as "high" if it was taught 
to more than one-half of the classes. Similarly, student achieve- 
ment on the item wa^ . ,ted as "high" if more than one-half of the 
students got the item correct. 




Tbachtrs Teaching. ..Students Learning 



The following graph demonstrates this analysis for one set 
of the Virginia data. 



ALOBBRAroft MOULAR CLAMB8 



100 
90 
•0 

70 
00 
50 
40 

SO 
20 
10 
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KEY 


(5) 


TYPE/ 


1 Integers 

2 Ratlonals 

3 Integer Exponents 

4 Formulas A Algebraic 
Expressions 

5 Polynomlals A Rational 
Expressions 

6 Equations A Inequations 

7 Relations A Functions 1 
0 Finite Sets { 


4 




1 




— ^ 






6 




— r*-« 

6 




4 












4 






TYPE/// 


rypE/v 6 



13 17 31 as 39 S3 S7 41 46 40 U 67 61 

acodaat Achtoramat 

(H Comet) 



Each qf the algebra items is represented by a single digit* The key 
identifies the mathematical content qf the item* Note, for example, the 
circled "5" (Type n item). The item deais with polynomials and rational 
expressions. It was reported taught by most teachers (over 90%) but fewer 
than 20% qf the students got it correct. For a complete analysis qf each 
item see Technical Report IST, 
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Teachers Teaching... Students Learning 



EOgh Teacher Covenge and High Student Achievement 
(Type I Itema) 

These items pei form as one would expect. A high proportion 
of teachers taught the content of the item and a high proportion 
of students got the item right. 

The data are reported by the four eighth grade class types: 
Remedial, General. Pre-algebra and Algebra. 

EIGHTH GRADE (TTEll A il) 

<x ^-^x .... 

A team scored an 
average of 3 points 
p>cr game over 5 
games. How many 
points altogether 
were scored in the 
5 games? 

A I D 5 
B I £15 



This item re^irtB the etudent to know a coneiderable amount about the 
avera^fe (asithmetic mean) qfaeet qfdata-es^^ciflcfUly, that the «um qf a 
»et qfecoree im equal to the averaiie multiplied by the mmber qf scores. 
Am the graph indicatee, teaehen qf all four close 4l!P«s reported high 
couerage qf this topic (SS% or more qf the claeeee). And etudent 
achievement wae high, with average ecoree qf 78% or more hi all class 

tir«». 

S2 




High Temcher Coverage and Low Student Achievement (Type 
n Items) 

These items, if they deal with important curricular content, 
are of concern. Teachers give the content high coverage but 
students find it difficult. 



EIGHTH GRADE (ITBIl B-28) 




6 cm 




6cm 




8 cm 8 cm 




The total area of 


the two triangles is? 
A e X 8 cnl^ 


B 






C 






D 


16x12^^ 


B-28 



In view qf the difficulty that students have with this item, perhaps this 
content is better 1^ until later grades, when studenU have developed 
moreintheirability todealwith asul^tqfthiscomplexity. Alternatively, 
^orts could be made to find more ^ective ways to teach the content. 



Teachers Teaching... Students Learning 



Low Teacher Coverage and Low Student Achievement {Type 
m Items) 

These items, if they deal with important currlcular content, 
are of concern for a different reason than for Type II items. 
Teachers are not teaching this content— and. correspondingly, 
students find it difficult. 

EIGHTH GRADE (rTEM A- 16) 




St\idcat 
AchlCTeLieBt 
(% Correct) 



X 




3 


6 


P 


y 




7 


9 


35 



The table above shows 

the values of x and y, 

where x is proportional 

to y. UTiat are the 

values of P and Q? 

A P=14 & Q=31 

B P=10&Q=14 

C P=10&Q=31 

D P=14&9=15 

E P=15&9=14 A-16 



As the data indicate, proportionality, as presented in a table format. Is 
di£ficultfor eighth graders-evenfor the algebra students. It could well b 
that prqfessional detfelopment workshops could be profitably devoted to 
topics qf proportionality-as it appears not ot ly in tabular forms, but in 
varieties of problem contexts* 
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Low Teacher Coverage and High Student Achievement (Type 
IV Items) 

These items are in some ways the most interesting. Teacher 
coverage is low but students do well on them. 



EIGHTH GRADE (TTEM CORE 13) 




Mttdent 
Achievement 
(% Comet) 



If P=LW and if 
P=12 and U3, then 
W is equal to? 

3 

^ 4 
B 3 

C 4 



D 12 



E 36 



Core 13 



The content qf this item, requiring some understanding qf algebraic 
relationships, isbyno metms trivial. The achievement qf students in every 
class type is encouraging* Perhaps this content is given some attention in 
the elementary grades* 
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Teachers Teaching.. Students Learnino 



With this background as to item types that were identified in 
the Virginia International MathemaUcs Assessment Project, 
further examples are provided « 

Eighth Grade 

High Teacher Coverage and High Student Achievement 
(Type I) 



Arithmetic 




1 

2 


X > 
4 


is equal to? 


A 


1 






8 






1 




B 






6 






2 




C 








8 






2 




D 






4 




E 


8 








4-25 



Measurement 



This routine arithmetic item received high coverage and was achieved 
well by most of the classes. 



oh 



ERIC 




A B 



1 unit 



The length of ABis 1 
unit. Which is the best 
estimate for the length 
of PQ? 
A 2 units 

B 6 units 

C ) units 

ij 14 units 

E 18 units 



0-8 



This estimation task, receiving high teacher cm^erage, was relatively easy 
for the students in all class types. 
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Teachers Teaching... Students Learning 



Eighth Grade 

High Teacher Coverage and High Student Achievement 
(Type!) 



Geometry 




Stndent 
Achierenent 
i% Comet) 



One of the following 
figures is congruent 
to the figure above. 
Which one? 



D ' 



4-16 



Algebra 




student achievement corresponds to teacher coverage for this item 
testing congruence. About one-ha\fof the remedial cl<isses were taught 
the content and one-ha\f of the remedial students were able to do the item 
correctly. 



The cost of printing greeting 
cards consists of a fixed 
charge of 100 cents and a 
charge of 6 cents for each 
card printed. Which of the 
following equations can be 
used to determine the cost 
of printing n cards? 
A cost=( 1 00+6 n) cents 
B cost=( 106+ n) cents 
C cost=(6+ 1 00 n) cents 
D cost=(106n) cents 
E cost=(600n) cents 3-12 



Formulating cm algebraic expressior* frcm a word problem was learned by 
relatively large proportions of students-even in the remedial classes. 
Note, however, that this topic was taught by veru few teachers qf the 
remedial classes (that is, for the remedial classes, it is a Type tV item). 
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Teachers Teaching... Students Learning 



Eighth Grade 

High Teacher Coverage and Low Student Achievement (Type 

m 



Arithmetic 



Teaeher 
Coverag* 
(% Taught) 



Stodaat 
AchieremeBt 
(% Correct) 



as 



2B 



50 



75 

100% 



Four 1-liter bowls of Ice 

cream were set out at a 

party. After the party, 1 

bowl was empty. 2 were 

half full, and 1 was three 

quarts s full. How many 

liters of tee cream had 

been EATEN? 
3 



A 3 



B 2 



C 2: 



E None of 
the above 

0-4 



Teacb«f 

(% Tai«ht) 



StadMit 
lehl«T«iiieiit 

(% Correct) 





■; 
















1 




■ 




■ 




■ 




1 




1 




1 




1 




1 











100% 

75 

50 

25 

0 

25 

50 

75 

100% 



$150 is divided in the 
ratio of 2 to 3. The 
smaller of the two 
amounts is? 

A $30 D $90 
B $50 E $120 
C $60 



4-32 



These were items that inuohted arithmetic operations (such as subtractingjraci ions or finding ratios) hut were imbedded in a problem situation. Although 
students seemed to he able to perform routine arithmetic computations, they were less succesafiil in identifying in a problem context those operations that 
needed to be performed. 



Teachers Teaching... STimENTs Learning 



Ei^th Grade 

High Teacher Coverage and Low Student Achievement (Type 

n) 



Geometry 



Te«ch«r 
Coverage 
(% Taoflit) 



Stodeat 
Achievement 
(H Cotrect) 



1 100% 
75 






SO 


5 




25 




12 


0 


What IS the value 


25 


of s? 


SO 






75 


A 


7 D 17 


100% 


B 


13 E None of 
these 




C 


15 

3-1 




If two triangles ai v 
SIMILAR, which of the 
following statements 
is TRUE? 

A Their corresponding angles 
MUST be congruent 

B Their corresponding sides 
MUST be congruent 

C Their corresponding sides 
MUST be parallel 

D They MUST have the 
same area 

E They MUST have the same 
shape and size 3.9 



These items indicate that the Pytha^rean Theorem and aspects of 
similarity are difficult for students. 



ERIC 



40 



D 



Teachers Teaching... STimENTs Learning 



Ei^th Grade 

High Teacher Coverage and Low Student Achievement (Type 

n) 



Geometry 



Te«ch«r 
Coverage 
(% Taoflit) 



Stodeat 
Achievement 
(H Cotrect) 



1 100% 
75 






SO 


5 




25 




12 


0 


What IS the value 


25 


of s? 


SO 






75 


A 


7 D 17 


100% 


B 


13 E None of 
these 




C 


15 

3-1 




If two triangles ai v 
SIMILAR, which of the 
following statements 
is TRUE? 

A Their corresponding angles 
MUST be congruent 

B Their corresponding sides 
MUST be congruent 

C Their corresponding sides 
MUST be parallel 

D They MUST have the 
same area 

E They MUST have the same 
shape and size 3.9 



These items indicate that the Pytha^rean Theorem and aspects of 
similarity are difficult for students. 
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Teachers Teaching... Students Learning 



Eighth Grade 

High Teacher Coverage and Low Student Achievement (Tjrpe 

n) 



Measurement 



0^ 



TmcImt 
Cotrmg* 
(% Tsvght) 



SCttdMt 
Achlevtmcat 
(% Cttmct) 



100 H 

75 

50 

as 

o 

as 

50 
75 

100 H 



A solid plastic cube with 
edges 1 centimeter 
long weighs 1 gram. How 
much will a solid cube 
of the same plastic weigh 
if each edge is 2 
centimeters long? 

A 8 grams 
B 4 grams 
C 3 grams 
D 2 grams 
E 1 gram 

0-10 



The problem of finding th^ volume of a cube whose edge (s doubled is 
difficult, not only for students in Virginia, but was a very difficult item 
internationally* 



Low teacher coverage and Low student achievement (Type m 
Items) 

Arithmetic 




SCttdaaC 
Achl«v«m«nt 

{% Comet) 



Match sticks are arranged 
as follows: 



If the pattern is continued, 
how many matchstlcks are 
used in making the 10th 
figure? 

A 30 

B 33 

C 36 

D 39 

E 42 4-12 



These tended to be non-routine items, such as finding patterns in numbers 
or identifying relationships in a table* These items require higher-level 
thinking skills. 



iErJc 
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Teachers Teaching. ••Students Learning 



Eighth Grade 

Loui teacher coverage and Loiu student achievement (Tjrpe m 
Items) 



Algebra 




X 


3 


6 


p 


y 


7 


g 


35 



The table above shows 
the values of x and y 
where x is proportional 
to y. What art the 
values of P and Q? 

A P=14&Q=31 

B P=10&Q=14 

C P=10&Q=31 

D P=14&Q=15 

E P=15&Q=14 M6 



Algebra 



{%Tmm0t) 




Aclil«v«B«at 

(%Con«ct) 



This item may he classified as Type Boras Type m, it depends on the class 
type. 



Soda costs a cents for each 
bottle. Including tlie deposit 
but there is a refund of b 
cents on each empty bottle. 
How much will Henxy have 
to pay for x bottles If he 
brings back y empties? 

A ax+hy cents 
B ax'by cents 
C (a-b)x cents 
D (a+x)-(b+y) cents 
E None of these 

4-27 



This item was, generally, not taught, except to the algebra classes. 
Apparently, this content is not regarded as part qf the e^hth grade 
mathematics* 
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Teachers Teaching. • .Students Learning 



Bl^th Grade 

LoiDteacher coverage and Low student achievement (Type m 
Items) 



Statistics 



(% Cornet) 



538 



50 
75 

100 H 



There are five black 
buttons and one red 
button In a Jar. If you 
pull out one button at 
random, what is the 
probability that you will 
get the red button? 



A 0 

B i 



E 1 



3-6 



Measurement 




i% Comet) 



Aspects qf simple probiMlity receive relatively little coverage by the 
eighth grade teachers. Student achievement is correspondingly lou. 



The measure of the angle 
shown is nearest to? 

A 155 
B 145 
C 50 
D 35 
E 15 

2-17 



The topic qf estimating the measure qfan mgle, as illustrated by this 
item, receives rather light teacher coverage. 
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Teachers Teaching... Students Learning 



Eighth Grade 

Low teacher coverage aud High student achievement (Type 
TV Items) 



Arithmetic 



y ^ 




8tad.nt 
AcbJvreaent 
Correct) 



162x45 is equal to? 

A 1378 

B 1458 

C 5890 

D 6290 

E 7290 



3-28 



Geometry 



CimTag. 
t% T.«g>t) 



Stodat 
Achieremut 

tH Correct) 




SO 

25 

0 

25 

SO 

76 

100% 



Items of this type may be part of the curriculum of the element sury grades 
(that iSf topics in grade school arithmetic with which the students are 
relatively proficient). 



102 




The figure above shows 
a wooden cube with one 
comer cut off and shaded. 
Which of the following 
drawings shows how this 
cube would look when 
viewed from directfy 
above? 



Spatial visualization, as represented by this item, was relatively easyfnr 
all students. Again, the performance of the remedial mathema^cs classes 
is noteu^^rthy. 
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Teachers Teaching... Students Learning 



Eighth Grade 

Low teacher coverage and High student achievement (Type 
iv:tenu) 



StatLitics 



100% 




Joe had three test scores 
of 78. 76 and 74. while 
Mary had scores of 72. 82 
and 74. How did Joe s 
average compare with 
Mary's? 

A Joe's was 1 point higher 
B Joe s was 1 point lower 
C Both averages were 

the same 
D Joe s was 2 points 

higher 
E Joe s was ^ points 

lower 2-9 



Measurement 



Work with averages^ om represented by thie item, received little Uocher 
coverage. Hot')ever the item uhmm fairly eaeyfor all qf the eighth grade 
etudente. 



iErJc 



hi 




iOO% 



100% 



The area of the shaded 
circle is what part of the 
area of the larger circle? 



D - 



B 



4-9 



Teacher coverage qf thie eetimatlon topic ivat light. However^ etudmt 
achievement woe rather good. 
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Teachers Teaching.. .Students Learning 



Twelfth Grade 

High teacher coverage and High student achievement (Tjrpe 
I) 



Advanced Algebra 

Topic: finding solution sets 




108 



erJc 



The solution set for the 
equaUon (1-2 x] (2+x)=0 
is? 



A :f -21 



C i-l.-21 



E I2.-2I 



2-14 



Elementary Junctions 

Topic: properties of functions 
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If xy = 1 and x If ';ieater 
than 0, which of the following 
statements is tme? 

A Whenx is greater than 

1 , y is negative. 
B When x is greater than 

1 , y is greater than 1 . 
C When x is less tnan 1 , 

y is less than 1 . 
D As X increases y 

increases. 
L Asx increases, y 

decreases i-io 



u:7 



Teachers Tbachino...Studbnt8 Lbarnino 



Twelfth Ormde 

Hfgh teacher cofenge end Low studest echleTemeat (Type 

m 

Advanced Algebra 

Topic: trigonometric relations 




ICS 



An angle d is known 

to be between 90 and 

180 andcos^O=— . 

25 

The value of sin 20 is then? 



A 


24 


D 


7 




25 




25 


B 


15 


E 


24 




25 




25 


C 


7 








25 







4-7 



Elementary Junctions 

Topic: composition of functions 




T>^ ^unctions/ and g are 
defined by /(x)= x-l and 

5(/(x))is equal to? 

A (x-1)(xt3)^ 

B (x+3)^-l 

C (2x-2)^ 

D (x+2)^ 



8-12 



Note: For the calculus classes, this ukis a high coverage - high achievefnent 
fTgp^O item. 



10. 9 
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Teachers Teaching. • .Students Learning 



Twelfth Grade 

Low teacher coverage and Low student achievement (Type 

ni) 

Acivwiced Algebra 

Topic; parametric equations 




btudent 
Acblevement 
{"^ Correct) 



What is the equation in 
X and y of the curve with 
parametric equations 



A X + y =1 
B X + y =2 
C x^+y^=4 
D x^- y ^=4 
E 2x^- y =4 



6-8 



Elementary JimctirAXS 

Topic: logarithmic functions 




100% 



100 H 



no 



Let y s4jc^, wlthx and 
y taking positive real 
values. When log x is 
plotted against log y the 
resulting graph will be? 

A a single point 

B a cubic curve 

C a parabola 

D a straight line 

E an exponential curve 

8-17 



1] 
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Teachers Teaching... Students Learning 



Twelfth Grade 

Lew teacher coverage and High student achievement (Type 
IV) 



Advanced Algebra 

Topic: vector operations 




1C3% 
71 


PgRSTU is a regular 


BO 


hexagon in which 


ae 


represents vector iT QR 


0 


represents vector iTand RS 


as 


represents vector w. FT 


BO 


represents? T S 






7S 




100% 


A 2 iT+iT \ ^ a" 




B ir+ ir+ iF n* ^ 




C 2( TT+iT+ur) 




D 2 TT+iT+ur 







ERIC 
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Pnobabatty 

Topic: elementary theoretical probability 



100% 
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A set of 24 cards is num- 
bered with the positive 
integers from 1 to 24< If the 
cards are shuffled and If 
only cne is selected at 
random, what is the proba- 
bility that the number on 
the card is divisible by 4 
ore? 



i 
6 
5 

24 

i 
4 



1 



4-14 



Ibsplementing SIMS at the Local Level 



Rationale for the Targeted Study 

The purpose of the Virginia International Mathematics 
Assessment Project was to develop a model for program assess- 
ment and evaluation at the state and local school levels in order 
to provide detailed high quality data that would be of use to 
curriculum supervisors, classroom teachers, and others in as- 
sessing the current curriculum and in identifying new directions 
for improvement. Hence, in order to look at the usefulness of the 
SIMS model at the local level, a study of the mathematics 
programs in two selected school divisions was conducted. 

Target Populations 

The target populations for the local school divisions were the 
same as those for the state study. This included all students 
enrolled in mathematics classes at the eighth grade level (Popu- 
lation A) and students enrolled in mathematics classes at the 
twelfth grade level having ? prerequisite of two years of algebra 
and one year of geometry (Population B). 

What Did the Targeted Study Involve? 

All classes in the target populations for both school divisions 
were tested. There was one significant difference between the 
study at the local level and the study at the state level. 

A pre-test and post-test were administered. This provided 
data on student achievement both at the beginning and at the end 
of the school year. The Pre-test data provided baseline data for 
teachers to use during the school year. 

Orientation for Sch 99l P^ra<;>ipngl An orientation meeting 
was held for administrators and teachers of the mathematics 
classes selected for the study. Participants were briefed on the 
purpose of VIMAP and the role the targeted school divisions 
would serve in the assessment project. Also, the curriculum 
analysis, which assessed the adequacy of the international test 
items for use in Virginia, r^is discussed. 
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During the meeting, teachers were told which of their classes 
would be involved in the project and given instructions on what 
their responsibilities would be. Teachers were given individually 
pr^ipared student packets of materials for each of their classes. 
Student packets contained test forms, answer sheets, and a 
student questionnaire. Teacher questionnaires and other mate- 
rials were also distributed at the meeting. 

Testing . Students in the targeted classes were tested .soon 
after the beginning of the school year. The eighth graders 
answered the Core Form test and one of four randomly assigned 
rotated forms; the twelfth graders were randomly assigned two of 
eight rotated test forms. Students were asked to fill out the 
student questionnaire providing valuable background inlbrma- 
tion for cuniculum and instructional use. 

Interpretation and Use of Pre-tcat Results . The State's 
Mathematics staff met with the participating teachers in each 
school division separately to assist them in interpreting pre- test 
results. Teachers were given the achievement results of e?ich of 
their classes by test form and by item. Summary data for the 
Population A schools and for the Population B schools weie dis- 
cussed and suggestions were made on how the data might be 
used. 

Teachers analyzed the data in light of what mathematics 
they had taught prior to pre-testing and the content yet to be 
covered in the local curriculum. The analysis of data was used 
to focus instruction on content the teachers considered impor- 
tant and where achievement was low. 

Post-testintf . The targeted mathematics classes were post- 
tested near the end of the school year. The same test forms taken 
in the beginning of the year were used. This made it possible to 
evaluate the achievement during the school year. Also, data from 
the post- test conld be compared with state and international 
estimates. 
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Analysis of Eighth Grade Data 

The pre-test and post-test achievement results were re- 
norted for each class and for all eighth grade classes in the school 
divisions. Achievement on items appearing on the Core Form was 
reported by groups of students taking each of the four rotated 
forms. The tables below illustrate the types of information 
reported. 

The analysis of achievement included a summary of the test 
statistics tor all items on a given form. A;i example, of a pre-test 
summary report appears in the table below. Individual class 
reports give the same tj^es of information. 



Pre-Test Summary of Statislics on Core Form Items 



Number of items 


40 


Possible low score 


0 


Mean score 


14,30 


Possible high score 


40 


Median score 


14,86 


Obtained low score 


0 


Standard Deviation 




Obtained high score 


13 


Reliability {KR-20) 




Number of scores 


98 


S.E. of Measurement 




Blank scores 


0 






Invalid scores 


0 






Valid scores 


98 




Ibiplbmenting SIMS at the Local Level 



The analysis of achievement also included information on 
each test form by item. Five quintlles of achievement scores were 
established for overall student achievement on each form. The 
number and percent of students in each quintile who answered 
the item correctly was reported. Also, the percent of students 
overall who answered the item correctly and each of the distrac- 
tors is given. 

Percent of Correct Responses by Fifths 

Quintlles 



1st + ♦ 

2nd+ • 

3rdH • 

4th + ♦ 

5th + ♦ 

+ + + + + + + + + + + 
0 10 20 30 40 50 60 70 80 90 100 

Percent 



Statistics in the graph above were taken from the following item. 

Item 1: 2 meters + 3 millimeters is equal to 

A, 2,0003 meters ♦B, 2,003 meters 
C, 2,03 meters D, 2,3 meters 

E, 5 meters 

*B is the correct choice 
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The number of students in each qulntlleand the percent of 
students overall who chose the correct answers and each dlstrac- 
tor is given in the chart below. 



Matrix of Responses By Fifths 



Qulutlles Answer Choices 








A 


(B) 


C 


D 


IT 






Number of Students 






1st 0 


17 


0 


0 


0 


2 


2nd 1 


10 


0 




0 


5 


3rd 0 


16 


0 


0 


0 


6 


4th 0 


17 


0 


0 


0 


5 


5th 0 


7 


0 


0 


0 


12 


Proportion of Students Answering 








.01 


(0.68) 


0 


0 


0 


0. 31 


Discriminating 


1- actor 










.06 


(0.32) 


0 


0 


0 


- 0. 34 



The three preceeding tables illustrate the types of in- 
formation reported in the item analysis using a specific test item 
from the Core Form. The data is a sample from a pre-test 
summary report. Individual class reports give the same types of 
information. 



Analjrsis of Twelfth Grade Dstm 

The pre- and post- test achievement results were reported by 
test form and by item for • ach class and for all twelfth grade 
classes in the targeted study. Achievement data was reported in 
the same way as the eighth grade population. 

Comments on Implementation at the Local Level 

The implementation was successfully carried out with little 
disruption to the schools involved. The evaluation process pro- 
vided the impetus for teachers and school administrators to 
examine their mathematics curriculum aiid to make sound 
educational decisions about changes needed. The two school 
divisions were also able to compare the achievement results of 
their students to both the Virginia and SIMS data. 

The experience caused teachers to reflect on instructional 
practices and to question the importance of some topics that are 
currently taught. The opportunity to examine an international 
mathematics curriculum provided an inservlce in and of itself. 

The data provided Information that will assist the local 
schools in monitoring and assessing their curricula, their in- 
service activities, and their student performance from a state and 
an international perspective. 



Eighth Grr.de Findings 



1. Overall, the mathematics achievement of eighth grade stu- 
dents in Virginia public schools exceeds that of eighth grade 
mathematics students across the United States. In the 
content areas of arithmetic, algebra, and statistics, Virginia 
students scored higher than the S, average; in geometry, 
they are identical; and in measurement, Virginia students 
scored only one point lower than the U. S. average. In 
addition, Virginia students scored higher than the interna- 
tional average in three of the Hve topic areas (arithmetic, 
algebra and statistics). 

2. In Virginia as in the United States as a whole, there is not just 
a single eighth grade mathematics curriculum. Instead, 
there is the typical country wide pattern of four distinct 
eighth grade mathematics programs: Remedial (for low- 
achieving students); General (for average studer^ls); Pre- 
algebra (for above-average students); and Algebra (for accel- 
erated students). 

3. The four programs differ greatly in terms of the kind and 
extent of mathematics content. The Remedial students are 
provided, mainly, with topics from arithmetic, with little ex- 
posure to geometry or algebra. The Genera! students are 
offered a review of topics in arithmetic and some exposure 
to topics in geometry, algebra and statistics. The Pre- 
algebra students are provided more c<mtent in algebra r.nd 
geometry than are the General students. The Algebra 
students are offered, typically, a freshman algebra course. 
These algebra students are. however, offered little geometry, 
probability, or statistics. 




Summary 



4. As a general pattern in Virginia (as in the United States as 
a whole), the level of achievement of eighth grade mathemat- 
ics students corresponds to the amount of mathematics that 
they are taught. For example, in algebra, the students in the 
Remedial classes have the lowest achievement scores (they 
are taught very little algebra), and the students in the 
Algebra classes have the highest scores (they are taught a 
relatively large amount of algebra), 

5. Some mathematics topics are relatively easy, on average, for 
students in all four eighth giade mathematics programs, 
even if the topics have not been taught at the eighth grade 
level. For example, spatial visualization was reported as not 
having much coverage in any of the four eighth grade 
programs. However, student achievement on items dealing 
with this topic was rather good ( and at about the same level) 
in all four programs. 

6. Other mathematics topics (for example, the Pythagorean 
Theorem) appear to be relatively difficult for most eighth 
grade students, even though the topic receives high teacher 
coverage. Such topics, if considered important for the eighth 
grade curriculum, would appear to need more effective 
instructional approaches (including, perhaps, the use of 
technology). 

7. Eighth grade students tend to have positive attitudes about 
mathematics. They want to do well in mathematics and 
would like to work at a job that uses mathematics. 
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Twelfth Grade Flndingg 

1. The achievement of twelfth grade advanced mathematics 
students in Vii^Snla is. on average, a few points higher than 
that of their counterparts across the United States. Espe- 
cially noteworthy is the higher Virginia achievement In 
algebra and calculus. 

2. !n most countries, (according to the SIMS report) all ad- 
vanced matiiematlcs students ^elfth grade) take calculus. 
Virginia, however, is like the United States as a whole In that 
only about one- third of the advanced students are enrolled 
in calculus classes. 

3. The achievement of the calculus students in Virginia is 
relatively high-about 8 percentage points above their U, S. 
counterparts and 1 1 points above the jitemational average. 
The achievement of the twelfth grade pre-calculus students 
was. like that of pre-calculus students across the United 
States, rather low. For example, performance was weak on 
many aspects of routine algebra content. 

4. Some mathematics topics, for example, exploring basic 
properties of a function, received high teacher coverage and 
tend to be easy for advanced mathematics students. Other 
topics, such elementary piobability theoiy. are found 
easy by students even though they tend not to be covered 
by teachers of the target classes. Still other topics are 
difficult, even though they receive high teacher coverage— for 
example, dealing with certain trigonometric relationships. 

5. The attitudes of the twelfth grade students toward mathe- 
matics tend to be positive. They believe that knowing mathe- 
matics will help them get a good Job and that their parents 
want them to do well in the subject. 




. . . the central problem for today and 
tomorrow is no longer access to 
school It is access to knowledge 
for all The true challenge is that of 
asswing both equity and quality in 
school programs. 

J. Goodlad 
(1985b) 
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Achlevtng Excellence In Bfathematics in Virginlm's Schools: 
I Some Recommended Next Steps 

!• Upgrading the content of the curriculum 

I In Virginia, the eighth grade mathematics that is available to 

most students includes repeated visits to grade school arithme- 
I tic. As the SIMS report for the United States has observed, from 

I an international point of view, eighth grade mathematics m the 

U. S. resembles much more the end f elementary school than the 
I beginning of secondary school (The Underachieving Curriculum. 

D page 95). Tlie content of the curriculum should therefore be 

upgraded to reflect recent developments in mathematics and the 
I demands of society and post-secondary education for quantita- 

' tively literate high school graduates. Data from this report, the 

Virginia SOL for Mathematics and national efforts such as the 
I report of the National Research Council ( 1 989), Evervb o dv Counts . 

■ provide useful guidelines for such curriculum reform activity, 

I 2, Restructuring the eighth grade mathematics curriculum 

J In Virginia, as in the United States, there is not an eighth 

I grade curriculum. Instead, there are four programs that differ 

greatly in the amount of mathematics made available to stu- 
I dents. The lower-ability students, in particular, are provided 

I mainly a repetition of topics in arithmetic from the grade school 

curriculum. The eighth grade curriculum should be restruc- 
I tured so that all students have the opportunity to learn some- 

I thing of the power and utility of mathematics. The Virginia 

international Study has demonstrated, that as students* oppor- 
I tunity to learn topics in mathematics increases, their achieve- 

I ment tends to increase accordingly. Again, data from VIMAP. 

SOL, and certain national studies provide important guidelines 
I as t ^ what should be included in this common core of mathemati- 

I cal knowledge, not only for eighth grade, but for each grade K- 1 2 , 
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Recombiendations 



3, Increasing the number of students who study mathematics: 
A PUMP, NOT A FILTER 

Evervbodv Counts the report of the National Research 
Council ( 1 989). has observed that, "more than any other subject, 
mathematics filters students out of programs leading to scientific 
and professional careers.., on average, we lose half the students 
from mathematics each year (from ninth grade through graduate 
school)..," (page 7), In Virginia, we need to find ways to retain 
more students in academic mathematics courses through high 
school. This can happen as the result of a variety of factors. For 
example, recommendation 1 can. among other things, serve to 
make mathematics a more attractive subject to study. Recom- 
mendation 2 will provide more youngsters with a better view as 
to what mathematics as a field of study is all about. Further- 
more, if we seek to increase enrollments in mathematics courses, 
we should capitalize on the positive attitudes of Virginia students 
toward mathematics. As noted in our report, large proportions 
of our students believe that it is important to know mathematics 
in order to get a good job. Students overwhelmingly feel that their 
parents wart them to succeed in mathematics. 

4. Clear expectations for achievement 

As new instructional programs are put into place, it will be 
important to clarify for students the expectations for achieve- 
ment that go along with these programs. An important part of 
this implementation phase will be effective methods for assessing 
how much mathematics students learn, and how they learn it. 
We need mathematics assessment that matches the state's 
curriculum and focuses on what students know and can do. 
rather than what they do not know. The NCl^ Curriculum and 



Evaluation Standards for School Mathematics provides useful 
guidelines as assessment procedures are established at the 
classroom, school and division levels. 

5. Classrooms as places for the teaching and learning of 
mathematics 

In Virginia, as in the United States as a whole, mathematics 
classrooms tend to be textbook-dominated. In many cases, 
relatively little use is made of instructional resources such as 
video-tapes, mathematical models or manipulatives. Instruc- 
tional use of computers and calculators as reported by teachers 
is rather limited as welL Ways should be found to enrich the 
climate of the mathematics classroom, providing forevery young- 
ster the experience of encountering mathematical ideas in a 
supportive, exciting, and productive environment. 
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Epilogue 

In the early 1980s, the National Science Board prepared for 
the National Science Foundation and the American people a 
report th-^t outlined a plan of action for "improving mathematics, 
science and technology education for all American elementary 
and secondary students so that their achievement is the best in 
tne world by 1995" (Educating Americans f or the 21st Centurv. 
1983). In the intervening years since the publication of that 
report, many initiatives at the national, state, and local levels 
have been undertaken to help accomplish the ambitious goals of 
the National Science Board, The Virginia International Mathe 
matics Assessment Project is an important part of the ongoing 
commitment we have to help assure that our students will 
continue to benefit from the vision of excellence of the National 
Science Board and of our state Department of Education, 



"Our mission is to prepare students 
for life in the 21st century. We 
must empower our young people 
with the skills and knowledge 
necessary to succeed in a world 
that has not yet been defined.'' 

Governor Elect L. Douglas Wilder 
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List of Technical Reports 

Over and beyond the Main Report for the Virginia Interna- 
tional Mathematics Assessment Project, there are five technical 
reports. A brief description of each report is listed below. These 
reports are available on a limited basis from the Commonwealth 
of Virginia; Department of Education; Mathematics Service; P.O. 
Box 6Q; Richmond. Virginia 23216-2060. 

I. Virginia International Mathematics Assessment 
Protect: Biathematlcs €^ mtm in Virginia "Technical 
Report I: Data Summary** 

This report includes a summary of data from all question- 
naires and all instruments used in the Study to collect data. This 
includes information from the Student Questionnaire Population 
A and Population B, Teacher Questionnaire Population A and 
Population B, Teacher General Classroom Processes Question- 
naire Population A and Population B, School Questionnaire 
Population A and Population B and Opportunity to Learn and 
Achievement Questionnaires for Population A and Population B. 

n. Virginia International Mathematics Assessment 
Project: Mathematics Counts in Virg inia **Technlcal 
Report n: Ttst Instruments" 

This report includes a copy of each test booklet used in the 
study for both Population A (eighth grade) and Population B 
(twelfth grade). 
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m. Virginia International Mathematics Assessment 
Project: Blathematlcs Counts in Virginia ""Technical 
Report m: A Guide for Replicating the Second Interna- 
tional Mathematics Study** 

This report is intended to serve as a guide for schools, school 
divisions and/or states for replicating the Second International 
Mathematics Study. It includes detailed information on the steps 
to follow in carrying out a study. 

IV. Virginia International Mathematics Assessment 
Project: Mathematics CounU in ^ginia **Technical 
Report IV: Teachers Teaching... Students Learning** 

This report includes a classiflcation of each test item used in 
the Virginia International Mathematics Assessment Project ac- 
cording to teacher coverage and to student achievement. As a 
result, the information therein allows the reader to take a detailed 
look at the teaching and learning of specific mathematical topics. 

V. Virginia International Mathematics Assessment 
Protect: M athematics Counts in Virginia "Technical 
Report V: Sampling** 

This report includes a description of the Sample Design for 
the Virginia International Mathematics Study for each of the two 
populations, Population A and Population B. The report also 
includes information that may be helpful to someone planning to 
replicate SIMS, such as: purpose of the sampling activities, 
procedure.' used to draw samples, quality control procedures 
and other such information. 
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Design of Samples for Statewide Mathematics Assessment in 
Virginia 

Target Populations 

The target populations for the study are: 

Population A: Students enrolled in mathematics classes 
offered at the eighth grade level. 
Population B: Students enrolled In mathematics classes 
at the twelfth grade level (classes requiring a prerequi- 
site of two years of algebra and one year of geometry). 

The study Is limited to regular public schools In Virginia. 
Private schools are not Included. According to Virginia Depart- 
ment of Education data. In the 1985-1986 school year, public 
schools had 95 percent of enrollment at the 8th grade level in 
public and private schools in Virginia, and 95 percent of enroll- 
ment at the 12th grade level. 

Sample Design - General 

The sample for each of the two student populations was a 
three-stage probability sample of students designed to be ap- 
proximately self vveightlng; i.e., to give each student in target 
population approximately the same probability of selection for 
assessment. The sample of schools for students of 12th grade 
mathematics were selected independently of the sample of schools 
for ' tudents of 8th grade mathematics. Eligible mathematics 
classes in schools selected In the sample were the sec'^nd-stage 
sampling units. 

At each grade level there are sets of test items in separate 
booklets rotated among students in the study sample, paralleling 
the design used In the Second International Mathematics Study. 
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The study design specified that all students In the sampled 
classes be tested. Within a class the booklets were spiralled 
(rotated) so that a fraction of the students responded to any item 
that appears in only one of the booklets (Le., a spiralled Item). 
This constituted the third stage of sampling. The design at each 
grade level differed somewhat In the following way. In tiie eighth 
grade, four spiralled (rotated) forms were used, together with a 40 
Item test (core test) taken by all students. In the twelfth grade, 
eight rotated forms were used; a core test was not used. 

ITie number of schools and students to be selected for each 
of the populations war determined, on the basis of available data 
on components of variance In the U.S. SIMS study, to meet 
samplinf reliability objectives for the assessment. These objec- 
tives were lo provide estimates of the percent of 8th grade 
students who would correctly answer a given test item, with a 
standard error of 5 percentage points at the ninety-five percent 
level of confidence, and similarly for 12th grade students. It was 
also an objective to provide estimates of the average percent of 
items correctly answered by 8th grade students and 12th grade 
studencs. The standard errors for these estimates would be 
expected to be smaller than the standard error for individual 
items. 

Sample Design - 8th Grade Level 

The sample for students of 8th grade mathematics was 
based on a stratified sample of 52 schools. Twf*nty-six strata of 
eligible schools were established, each representing approxi- 
mately the same number of 8th grade mathematics classes, and 
a sample of two schools was randomly selected per stratum. 

For purposes of stratifying schools, the average 8th grade 
SRA mathematics score for each School Division for the previous 
school year and enrollment by school was available centrally. 



School Divisions having 8th grade enrollment of 500 students or 
more were asked to provide the average 8th grade SRA mathe- 
matics score for each school in the Division. These divisions 
accounted for approximately seventy-five percent of 8th grade 
enrollment. In the stratum of large divisions schools were 
stratified by their average SRA mathematics scores, and in the 
stratum of Divisions with 8th grade enrollment under 500, 
schools were stratified by division average 8th grade SRA mathe- 
matics score. Four strata of SRA scores were defined. Within 
each of these strata, schools were further stratified by enrollment 
size and sampling strata defined so as lo represent approximately 
an equal number of 8th grade classes. A sample of two schools 
per stratum was then selected with equal probability, and an ex- 
pected four classes subsampled per selected school. (Schools 
estimated to have fewer than four 8th grade classes were sampled 
at the overall rate and all classes in the selected schools were 
included in the study.) 

For sampling classes within schools, the selected schools, 
were asked to provide a list of their 8th grade mathematics 
classes with some indication as to ability grouping, if any. by 
class within school. Small classes were grouped as feasible to 
provide sampling units of approximately the same size. The 
sampling units were then randomly selected. In large schools the 
classes were further grouped into two strata within the school 
prior to sampling and two sampling units were selected per 
stratum. 

Sample Design 12th Grade Level 

The design for a sample of students in 12th grade level 
mathematics classes (Population B) paralleled that for the sample 
of 8th grade students. 
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Twenty-six strata of eligible schools were established, and 
schools were selected by simple random sampling per stratum. 
Schools were stratified by two criteria: (1) average 1 1th grade 
SRA mathematics score for the school based on the most recent 
testing or. if not available, the average for the Division to which 
the school belongs; and (2) a me- sure of the size of enrollment in 
the 1 2th grade level mathematics. Four strata of SRA scores were 
defined, and within these, schools were further stratified by 
mathematics enrollment size. Average score by school was 
available for schoolj, havmg about 90 percent of the eligible 
enrollment. The measure of enrollment size (MOS) used for the 
size stratification of individual eligible schools was based on 
centrally available data by schools as to enrollment in the 12th 
grade level mathematics classes (E). as follows: 

E MOS 



under 100 1 
100-199 E/23.1 rounded up 

200 and over E/25.1 rounded up 



Strata were defined to be of approximately equal size in 
terms of the MOS. A sample of two schools per stratum was 
selected with equal probability and 1 2th grade level mathematics 
classes were subsampled to provide an approximately self- 
weighting sample with an expected 100 eligible students tested 
per school. There are 194 schools with estimated 12th grade 
enrollment under 1 00. These were sampled at the overall student 
rate and all students in the selected schools were tested. 

There were 8 test booklets but two testing sessions per 
student so that, again, any spiralled test item was taken by a 
fourth of the students. 
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Sumnuuy of the Sampling and Cooperation Rate 

The final results for the sampling and testing are as follows: 

Population A Population B 



(regular 8th grade (12th grade level 
mathematics mathematics 
classes) classes) 



Schools 



Number in sample 52 52 
Number cooperating 51 51 
CooperaUon rate 98 % 98% 



Eligible mathematics classes 



Number in sample 216 169 
Number not approached 2 

Net 209 169 

Number tested 209 169 

CooperaUon rate 100 % 100% 



Eligible 


students 




Enrollment in tested classes 


4.612 


3.500 


Number tested (records 






in the assessment file) 


4.506 


3.331 


Cooperation rate 


95 % 


95% 
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